APS/123-QED 



Transition from phase to generalized synchronization in 

time-delay systems 

D. V. Senthilkumar 1 ]*] M. Lakshmanan 1 [] and J. Kurths 2 ^ 

1 Centre for Nonlinear Dynamics, 
Department of Physics, 
Bharathidasan University, 
Tiruchirapalli - 620 024, India 
and 

2 Institute of Physics, 
University of Potsdam, 
Am Neuen Palais 10, 
14469 Potsdam, Germany 

(Dated: April 22, 2008) 



1 



Abstract 



The notion of phase synchronization in time-delay systems, exhibiting highly non-phase-coherent 
attractors, has not been realized yet even though it has been well studied in chaotic dynamical sys- 
tems without delay. We report the identification of phase synchronization in coupled nonidentical 
piece- wise linear and in coupled Mackey-Glass time-delay systems with highly non-phase-coherent 
regimes. We show that there is a transition from non-synchronized behavior to phase and then 
to generalized synchronization as a function of coupling strength. We have introduced a transfor- 
mation to capture the phase of the non-phase coherent attractors, which works equally well for 
both the time-delay systems. The instantaneous phases of the above coupled systems calculated 
from the transformed attractors satisfy both the phase and mean frequency locking conditions. 
These transitions are also characterized in terms of recurrence based indices, namely generalized 
autocorrelation function P(t), correlation of probability of recurrence (CPR), joint probability of 
recurrence (JPR) and similarity of probability of recurrence (SPR). We have quantified the dif- 
ferent synchronization regimes in terms of these indices. The existence of phase synchronization 
is also characterized by typical transitions in the Lyapunov exponents of the coupled time-delay 
systems. 
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Synchronization of chaotic oscillations is one of the most fundamental phe- 
nomena exhibited by coupled chaotic oscillators. Since the identification of 
chaotic synchronization in identical systems, several different kinds of synchro- 
nizations such as generalized, phase, lag, anticipatory and intermittent synchro- 
nizations have been identified and demonstrated. Among them chaotic phase 
synchronization (CPS) plays a crucial role in understanding a large class of 
weakly interacting nonlinear dynamical systems. Even though the notion of 
CPS has been well studied in several low-dimensional chaotic dynamical systems 
during the past decade, CPS in time-delay systems (which are effectively infinite- 
dimensional) has not yet been identified and reported. A main problem here is 
to define even the notion of phase itself due to the presence of intrinsic multiple 
characteristic time scales of the chaotic attractors. Time-delay systems often 
exhibit complicated non-phase-coherent attractors (which do not have proper 
rotation around a fixed reference point) with many positive Lyapunov expo- 
nents. Hence, the conventional techniques available in the literature to define 
phase and to identify CPS cannot be used in the case of time-delay systems. 
In order to overcome this difficulty, we have introduced a nonlinear transforma- 
tion which transforms the non-phase-coherent chaotic/hyperchaotic attractors 
of specific time-delay systems into phase-coherent attractors. The transformed 
attractors allow for the use of conventional methods to identify phase and CPS 
in time-delay systems. We have also confirmed the onset of phase and the tran- 
sition from desynchronized state to phase synchronization and its subsequent 
transition to generalized synchronization as a function of coupling strength us- 
ing recurrence based indices. These results are also corroborated by the changes 
in the Lyapunov exponents of the coupled time-delay systems. 



I. INTRODUCTION 



Synchronization of chaotic oscillations is a fundamental nonlinear phenomenon observed 
in diverse areas of science and technology. Since the first identification of chaotic synchro- 
nization, several types of synchronization have been identified and demonstrated both theo- 



retically and experimentally 



Complete (or identical) synchronization 
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generalized synchronization [s[ [h]] and phase synchronization [ll, Q] are the three main 
types of synchronization that have been characterized by the difference in the degree of 
correlation between the interacting chaotic dynamical systems. Among these, chaotic phase 
synchronization (CPS) has become the focus of recent research as it plays a crucial role 
in understanding the behavior of a large class of weakly interacting dynamical systems in 
diverse natural systems including circadian rhythm, cardio-respiratory systems, neural os- 
cillators, population dynamics, etc . Definition of CPS is a direct extension of the 
classical definition of synchronization of periodic oscillations and can be referred to as en- 
trainment between the phases of interacting chaotic systems, while the amplitudes remain 
chaotic and, in general, non-correlated [jjjl (see also Appendix IAT) . 

The notion of CPS has been investigated so far in oscillators driven by external periodic 
force 



15 



Il6|, c haotic oscillators with different natural frequencies and/or with parameter 



0, Q, [ 



Q, arrays o 



mismatches {ill, 

sentially different chaotic systems 2l|, [22j. In addition CPS has also 
experimentally in various syste ms, such as electrical circuits 2ll . Q, 2^ . 



coupled chaotic oscillators Q, |20j and also in es- 

aeen demonstrated 



fluids 



25(, lasers |26|,|27|, 



281 ] . biological systems 2JJ, |30[], climatology [311 ] . etc. On the other hand CPS in 



nonlinear time-delay systems, which form an important class of dynamical systems, have 
not yet been identified and addressed. A main problem here is to define even the notion 
of phase in time-delay systems due to the intrinsic multiple characteristic time scales in 
these systems. Studying CPS in such chaotic time-delay systems is of considerable impor- 
tance in many fields, as in understanding the behavior of nerve cells (neuroscience), where 



memory effects 
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P 
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a prominent role, in physiological studies, in ecology, in lasers, etc 
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36]. 



While studying CPS, one usually encounters with the terminologies phase-coherent and 
non-phase-coherent chaotic attractors. If the flow of a dynamical system has a proper ro- 
tation around a fixed reference point, then the corresponding attractor is termed as phase- 
coherent attractor. In contrast, if the flow does not have a proper rotation around a fixed 
reference point then the corresponding attractor is called as non-phase-coherent attractor. 
(More discussion on the distinction between the phase-coherent and non-phase-coherent 
chaotic attractors along with an illustration is given below in Appendix [A} . While methods 
have been well established in the literature to identify phase and to study CPS in phase- 
coherent chaotic attractors (see again Appendix El), methods to identify phase of non-phase- 
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coherent chaotic attractors have not yet been well established. Even the most promising 
approach based on the idea of curvature to calculate the phase of non-phase-coherent at- 
tractors is limited to low- dimensional systems and unfortunately methods to identify phase 
and to study CPS in time-delay systems which often posses highly complicated hyperchaotic 
attractors have not yet been identified and reported. 

Recently, we have pointed out briefly the identification of CPS in unidirectionally cou- 
pled nonidentical time-delay systems exhibiting hyperchaos with highly non-phase-coherent 
attractors 37|. In this paper we present our detailed results on the identification and exis- 
tence of CPS in coupled piecewise-linear time-delay systems and in coupled Mackey-Glass 
time-delay systems with parameter mismatches. We will show the entrainment of phases of 
the coupled systems from asynchronous state and its subsequent transition to generalized 
synchronization (GS) as a function of coupling strength. Phases of these time-delay sys- 
tems are calculated using the Poincare method after a newly introduced transformation of 
the corresponding attractors, which transforms the original non-phase- coherent attractors 
of both the systems into smeared limit cycle like attractors. Further, the existence of CPS 
and GS in both the coupled systems are characterized by recently proposed methods based 
on recurrence quantification analysis and in terms of Lyapunov exponents of the coupled 
time-delay systems. Thus, the main results of our paper are 

1. Suitable nonlinear transformation involving delay time can be introduced which trans- 
forms a chaotic/hyperchaotic non-phase-coherent attractor to a phase-coherent attrac- 
tor. Then it is easier to find the onset of CPS, GS, etc. using these transformed 
phase-coherent attractors. 

2. Recurrence based indices can be directly used to identify phase, CPS, GS from the 
original non-phase- coherent chaotic/hyperchaotic attractors. 

3. Lyapunov exponents also work as a good guide for the synchronization transitions 
involving chaotic /hyperchaotic non-phase-coherent attractors. 

The plan of the paper is as follows. In Sec. II, a brief discussion about the concept of 
CPS (the possibility of estimation of the phase in chaotic systems is presented in detail in 
Appendix [A]) and details of the time-delay systems, namely, piece-wise linear time-delay 
system and Mackey-Glass system under investigation are presented. In Sec. Ill, we point 
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out the existence of CPS and GS in unidirectionally coupled piecewise-linear time-delay sys- 
tems using the Poincare section technique (after the introduced transformation), recurrence 
quantification analysis and Lyapunov exponents of the coupled systems. We will also discuss 
the existence of CPS and GS in unidirectionally coupled Mackey-Glass time-delay systems 
in Sec. IV, using the above three different approaches. Finally in Sec. V, we summarize our 
results. 



II. CPS AND TIME-DELAY SYSTEMS 

CPS has been studied extensively during the last decade in various nonlinear dynamical 
systems as discussed in the introduction. However, only a few methods have been available 



in the literature 



4| (for more details see Appendix [SJ to calculate the phase of chaotic 
attractors but unfortunately some of these measures are restricted to phase-coherent chaotic 
attractors, while the others to non-phase-coherent chaotic attractors of low-dimensional 
systems. It is to be noted that these conventional methods available so far in the literature 
(as discussed briefly in the Appendix |A]) to identify phase of the phase- coherent /non-phase- 
coherent attractors cannot be used in the case of time-delay systems in general, as such 
systems will very often exhibit more complicated attractors with more than one positive 
Lyapunov exponents. Correspondingly methods to calculate the phase of non-phase-coherent 
hyperchaotic attractors of time-delay systems are not readily available. The most promising 
approach available in the literature to calculate the phase of non-phase- coherent attractors 
is based on the concept of curvature j^, but this is often restricted to low-dimensional 
systems. However, we find that this procedure does not work in the case of nonlinear 
time-delay systems in general, where very often the attractor is non-phase-coherent and 
high-dimensional. Hence defining and estimating phase from the hyperchaotic attractors of 
the time-delay systems itself is a challenging task and so specialized techniques/tools have 
to be identified to introduce the notion of phase in such systems. 

It is to be noted that a variety of other nonlinear techniques such as mutual information, 
recurrence analysis, predictability etc. can be used to identify basic types of synchroniza- 
tion [39[ . In particular, mutual information, predictability and their variants have been used 
for characterizing the existence of complete synchronization, generalized synchronization and 
the interdependencies among the measured time series of dynamical systems HQ ,|4l|,|42|. 
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Mutual information can also be used to measure the degree of PS 43j, see also Sec. IIII Al 
below, provided that phase is already defined. Recently, recurrence based indices are shown 
to be excellent quantifiers 39] of basic kinds of synchronization including CPS in low di- 
mensional systems and even in the case of noisy, non-stationary data's. However, as far as 
we know predictability cannot be used either to define or to identify PS. In any case these 
measures have not been used so far to identify phase or CPS in time-delay systems. 

In order to define/estimate phase and CPS in time-delay systems, in this paper we have 
introduced three different approaches. Firstly, we have introduced a nonlinear transforma- 
tion involving time-delay variable that transforms the non-phase- coherent attractors into 
phase-coherent attractors. After this transformation of the original non-phase-coherent at- 
tractor, the transformed attractor allows one to use the conventional techniques. Next, we 
have used the recently introduced recurrence based indices for the first time in time-delay 
systems to identify the onset of PS and subsequent transition to GS. Finally, the transition 
is also confirmed by the changes in the spectrum of Lyapunov exponents of the coupled 
time-delay system. Further, we find that all these three approaches are in good agreement 
with the indication of onset of CPS. 

As prototypical examples of nonlinear time-delay s yst ems, we consider two specific mod- 
els, namely, (i) a piece-wise linear time-delay system 



44 



45 



time-delay system 
systems. 
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46| and (ii) the Mackey- Glass 



47] and investigate the existence of CPS in the corresponding coupled 



A. Piece-wise linear time-delay system 



He 



he following scalar first order delay differential equation was introduced by Lu and 
44J and discussed in detail by Thangavel et al. [45j, 



x(t) 



-ax(t) + bf(x(t — t)), 



(1) 
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where a and b are parameters, r is the time-delay and / is an odd piecewise linear function 
defined as 

0, x < -4/3 

-1.5a; - 2, -4/3 < x < -0.8 

/0) = < x, -0.8 < x < 0.8 

-1.5x + 2, 0.8 < a; < 4/3 

0, x > 4/3 



(2) 



Recently, we have reported [46| that systems of the form exhibit hyperchaotic 
behavior for suitable parametric values. For our present study, we find that for the choice 
of the parameters a = 1.0,6 = 1.2 and r = 15.0 with the initial condition x(t) = 0.9, t 6 
(—15,0), Eq. ([1]) exhibits hyperchaos. Detailed linear stability analysis, bifurcation analysis 
and transient effects have been studied in ref. The corresponding pseudoattractor is 

shown in the Fig. QJi. The hyperchaotic nature of Eq. ([1]) is confirmed by the existence of 
multiple positive Lyapunov exponents. The first ten maximal Lyapunov exponents for the 
above choice of parameters as a function of delay time r e (2, 29) are shown in Fig. [2h. (the 



spectrum o 
by Farmer 



Lyapunov exponents in this paper are calculated using the procedure suggested 
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Studying synchronization in coupled systems of the form ([I]) is particularly appealing 
because of the facts that (i) system ([1]) exhibits a hyperchaotic attractor even for very small 
values of the delay time r for appropriate values of the system parameters (the spectrum of 
Lyapunov exponents as a function of delay time r is shown in Fig. [2^) and (ii) it is easily 
experimentally realizable as the piece-wise linear function can be constructed readily and 
only low values of delay time are required for construction of a hyperchaotic attractor. 

B. Mackey- Glass system 



The second model we have used for the investigation of CPS is a model of blood produc- 
tion due to Mackey and Glass 32]. It is represented again by Eq. ([Tj) but with the following 
functional form for f(x) 



f(x) = x(t - r)/(1.0 + x{t - r) 10 ). 



(3) 
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FIG. 1: (a) The non-phase coherent hyperchaotic attractor of the drive (jlh.) and (b) The non-phase 
coherent hyperchaotic attractor of the uncoupled response ([lb) 

Here, x(t) represents the concentration of blood at time t, when it is produced, and 
x(t — t) is the concentration when the "request" for more blood is made. In patients with 
leukemia, the time r may become excessively large, and the concentration of blood will 
oscillate, or if r is even larger, the concentration can vary chaotically, as demonstrated by 
Mackey and Glass 
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47l | . This is a prototype model for delay systems exhibiting highly 
non-phase-coherent chaotic attractors and even hyperchaotic attractors for large value of 
delay time (r > 28). The pseudo-chaotic attractor of the Mackey-Glass system (JTJ) and (J3j) 
for the standard parameter values a = 0.1, b = 0.2 and r = 20 with the initial condition 
x(t) = 0.8, t G (—20, 0) is shown in the Fig. [TUh in Sec. IV below. The spectrum of Lyapunov 
exponents as a function of delay time r G (14, 37) is shown in Fig. [9k (see Sec. IV below). 



III. CPS IN COUPLED PIECEWISE-LINEAR TIME-DELAY SYSTEMS 



We first consider the following unidirectionally coup 
systems, which we have recently studied in detail in 48, 



ed drive X\{t) and response x 2 (t) 



49J 



±i(t) = -axi(t) +b 1 f(x 1 (t - r)), 

x 2 (t) = -ax 2 (t)+b 2 f(x 2 (t-T)) + b 3 f(x 1 (t-r)), 



(4a) 
(4b) 



where b\, b 2 and 63 are constants, a > 0, r is the delay time and f(x) is the piece- wise linear 
function of the form ([2]). 



We have chosen the values of parameters as (same values as studied in ref. 37]]) a = 
1.0,6i = 1.2, 62 = 1.1 and r = 15. For this parametric choice, in the absence of coupling, 
the drive X\(t) and the response ^(i) systems evolve independently. Further in this case, 
both the drive Xi(t) and the response X2(t) systems exhibit hyperchaotic attractors with five 
positive Lyapunov exponents and four positive Lyapunov exponents, respectively, i.e. both 
subsystems are qualitatively different (due to b\ 7^ 6 2 )- The corresponding attractors are 
shown in Figs. [T^, and [lb, respectively, which clearly show the non-phase-coherent nature. 



The Kaplan and Yorke 47|, [5(| dimension for the above attractors turn out to be 8.40 and 



7.01, respectively, obtained by using the formula 

D L =J + ^f^, (5) 

where j is the largest integer for which Ai + ... + Xj > 0. The parameter 6 3 is the coupling 
strength of the unidirectional nonlinear coupling (jib), while the parameters b\ and 62 play 
the role of parameter mismatch resulting in nonidentical coupled time-delay systems. The 
spectrum of the first ten largest Lyapunov exponents of the uncoupled system (jUi) for the 
values of the parameters a = 1.0 and b\ = 1.2 in the range of time-delay r 6 (2, 29) is shown 
in Fig. [2^ and that of the system (jib) for the parameter value 62 = 11 in the same range of 
delay time is also shown in Fig. [2b. 

Now the task is to identify and to characterize the existence of CPS in the coupled time- 
delay systems (jlj), possessing highly non-phase- coherent hyperchaotic attractors, when the 
coupling is introduced (b 3 > 0). In the following we present three different approaches to 
study CPS in coupled piecewise-linear time-delay systems (jlj). 



A. CPS from Poincare section of the transformed attractor (Fig. [3b) 

We introduce a transformation to successfully capture the phase in the present problem. 
It transforms the non-phase coherent attractor (Fig. [3^) into a smeared limit cycle-like form 
with well-defined rotations around one center (Fig. [3b)- This transformation is performed 
by introducing the new state variable 

z(t + r) = zit + r, f) = xi(t)xx{t + f)/xi{t + r), (6) 

where f is the optimal value of delay time to be chosen (so as to rescale the original non-phase 
coherent attractor into a smeared limit cycle-like form) , and then we plot the above attractor 
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FIG. 2: The first ten maximal Lyapunov exponents X max of (a) the scalar time-delay system ([T]) 
and ([2|) or (|3£i) for the parameter values a = 1.0, b\ = 1.2, r G (2, 29) and (b) the scalar time-delay 
system (jib) for the parameter values a = 1.0, b\ = 1.1 in the same range of delay time in the 
absence of the coupling 63. 
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FIG. 3: (a) The non-phase coherent hyperchaotic attractor of the uncoupled drive (T4h,) and (b) 
Transformed attractor in the xi(t + r) and z(t + r) space. Here the Poincare points are represented 
as open circles. 

(Fig. [3^) in the (xi(t + r), zit + r)) phase space. The functional form of this transformation 
(along with a delay time f) has been identified by generalizing the transformation used in 
the case of chaotic atractors in the Lorenz system |4j , so as to unfold the original non-phase- 
coherent attractor (Fig. [3^) into a phase-coherent attractor. We find the optimal value of 
f for the attractor (Fig. [3^) of the piecewise linear time-delay system to be 1.6. It is to be 
noted that on closer examination of the transformed attractor (Fig. [3b) in the vicinity of the 
common center, it does not have any closed loop (unlike the case of the original attractor 
(Fig. EK)) even though the trajectories show sharp turns in some regime of the phase space. 
If it is so, such closed loops will lead to phase mismatch, and one cannot obtain exact 
matching of phases of both the drive and response systems as shown in Fig. H] and discussed 
below. Now the attractor (Fig. [3b) looks indeed like a smeared limit cycle with nearly well 
denned rotations around a fixed center. 

It is to be noted that the above transformation ([6]) can be applied to the non-phase- 
coherent attractors of any time-delay system in general, except for the fact that the optimal 
value of f should be chosen for each system appropriately through trial and error by requir- 
ing the geometrical structure of the transformed attractor to have a fixed center of rotation. 
We have adopted here a geometric approach for the selection of f and look for an optimum 
transform which leads to a phase- coherent structure. This is indeed demonstrated for the 
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FIG. 4: Phase differences (A0 = (j)f(t) — between the systems and ([lb) for different 

values of the coupling strength 63 = 0.0, 1.0, 1.3, 1.4 and 1.5. 

attractor of Mackey- Glass system in the next section. The motivation behind this transfor- 
mation has came from the transformation (IA6[) which is well known in the case of Lorenz 
attractor discussed in the Appendix [A] The main point that we want to stress here is that 
even for highly non-phase-coherent hyperchaotic attractors of time-delay systems, there is 
every possibility to identify suitable transformations of the type ([6]) to unfold the attractor 
and to identify phase as demonstrated in the above two typical cases of time-delay systems. 
One may ask a pertinent question here as to whether there exists a deeper underlying math- 
ematical structure regarding such a transform. We do not have an answer to this question 
at present and this remains an open problem. 

Therefore, the phase of the transformed attractor can be now defined based on an appro- 
priate Poincare section which is transversally crossed by all trajectories using Eq. (1A4j) given 
in Appendix A. Open circles in Fig. [3b correspond to the Poincare points of the smeared 
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limit-cycle-like attractor. Phases, <fi\{t) and </>!(£), °f the drive and the response X2(t) 
systems, respectively, are calculated from the state variables z\(t + r) and z 2 (t+r) according 
to Eq. (jS]). The existence of 1:1 CPS between the systems (j3J is characterized by the phase 
locking condition 

|#(t)-$(t)| < canst. (7) 

The phase differences (A<j) = <frl(t) — <f) 2 (t)) between the systems (HK) and (j4b) are shown 
in Fig. H]for different values of the coupling strength b 3 . The phase difference A0 between 
the systems ((Ik) and (jib) for b 3 = 0.0 (uncoupled) increases monotonically as a function of 
time confirming that both systems are in an asynchronous state (also nonidentical) in the 
absence of coupling between them. For the values of 63 = 1.0 and 1.3, the phase slips in 
the corresponding phase difference A(f> show that the systems are in a transition state. The 
strong boundedness of the phase difference specified by Eq. ([7]) is obtained for 63 > 1.382 
and it becomes zero for the value of the coupling strength b 3 = 1.5, showing a high quality 
CPS. 

The mean frequency of the chaotic oscillations is defined as [14] . H ] 

"1,2 = m >2 (t)/dt) = Km ± / Mt)dt, (8) 

and the 1:1 CPS between the drive Xi(t) and the response x 2 (t) systems can also be char- 
acterized by a weaker condition of frequency locking, that is, the equality of their mean 
frequencies Q± = Q 2 . The mean frequency ratio ^2/^1 and its difference AQ = Q 2 ~ ^1 
are shown in Fig. Eh as a function of the coupling strength 6 3 6 (0,3). It is also evident 
from this figure that the mean frequency locking criterion ([8]) is satisfied for 63 > 1.382 from 
which both the frequency ratio f^/^i and their difference Afl show substantial saturation 
in their values confirming the strong boundedness in the phases of both the systems. 

The above results can be further strengthened by measuring the degree of PS quantita- 



tively through the concept mutual information between the cyclic phases 43j 



where p\(i) and p 2 {j) are the probabilities when the phases 0i and <j) 2 are in the ith and 
jth bins, respectively, and p{i,j) is the joint probability that <p\ is in the ith bin and 4> 2 in 
the jth bin. However, it is to be noted that mutual information between the phases can be 

14 



used only to characterize the degree of PS provided phase has already been defined/known. 
Hence mutual information can be used only as an additional quantifier for measuring the 
degree of phase synchronization. Mutual information M as a function of coupling strength 
63 G (0, 3) is shown in Fig. \5jp, which clearly indicates the high degree of PS for 6 3 > 1.382 
in good agreement with the frequency ratio f^/^i and their difference AQ shown in Fig. Eh- 



B. CPS from recurrence quantification analysis 

The complex synchronization phenomena in the coupled time-delay systems fflh can also 



be analyzed by means of the very recently proposed methods based on recurrence plots 39 , 



511 ]. These methods help to identify and quantify CPS (particularly in non-phase coherent 
attractors) and GS. 

For this purpose, the generalized autocorrelation function P(t) has been introduced in 



39 



511 ] as 

N-t 

p (*) = W^t £ 0(e " 1 |x * - ***H)' (10) 
1=1 

where is the Heaviside function, Xj is the zth data corresponding to either the drive 
variable x\ or the response variable x 2 specified by Eqs. fl4]) and e is a predefined threshold. 
|.| is the Euclidean norm and N is the number of data points. P(t) can be considered as 
a statistical measure about how often <p has increased by 2ir or multiples of 2tt within the 
time t in the original space. If two systems are in CPS, their phases increase on average 
by K.2tt, where K is a natural number, within the same time interval t. The value of K 
corresponds to the number of cycles when \\X(t + T) — ~ 0, or equivalently when 

I \X(t+T) —X(t) 1 1 < e, where T is the period of the system. Hence, looking at the coincidence 
of the positions of the maxima of P(t) for both systems, one can qualitatively identify CPS. 

A criterion to quantify CPS is the cross correlation coefficient between the drive, Pi(t), 
and the response, P2{t), which can be defined as Correlation of Probability of Recurrence 
(CPR) 

CPR=(P 1 (t)P 2 (t)}/a 1 a 2} (11) 

where Pi, 2 means that the mean value has been subtracted and a± t 2 are the standard de- 
viations of P\{t) and P2[t) respectively. If both systems are in CPS, the probability of 
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recurrence is maximal at the same time t and CPR ~ 1. If they are not in CPS, the maxima 
do not occur simultaneously and hence one can expect a drift in both the probability of 
recurrences and low values of CPR. 

When the systems 01]) are in generalized synchronization, two close states in the phase 
space of the drive variable correspond to that of the response. Hence the neighborhood 
identity is preserved in phase space. Since the recurrence plots are nothing but a record 
of the neighborhood of each point in the phase space, one can expect that their respective 
recurrence plots are almost identical. Based on these facts two indices are defined to quantify 
GS. 

I — L 

First, the authors of [51| proposed the Joint Probability of Recurrences (JPR), 



w ££ ( e * - I \ x i - XjWMe y - 1 IK- - nil) - RR 

l-RR 



JPR = xi^iAZXl -_ZllL_p — - ( i2) 



where RR is rate of recurrence, e x and e y are thresholds corresponding to the drive and 
response systems respectively and Xi is the ith data corresponding to the drive variable x\ 
and Yi is the zth data corresponding to the response variable x 2 specified by Eqs. fl3|. RR 
measures the density of recurrence points and it is fixed as 0.02 [5l|]. JPR is close to 1 for 
systems in GS and is small when they are not in GS. The second index depends on the 
coincidence of the probability of recurrence, which is defined as Similarity of Probability of 
Recurrence (SPR), 

SPR = 1 - ((AW - P 2 (t)) 2 )/a 1 a 2 . (13) 

SPR is of order 1 if both systems are in GS and approximately zero or negative if they evolve 
independently. 

Now, we will apply these concepts to the original (non-transformed) attractor (Fig. EK)- 
We estimate these recurrence based measures from 5000 data points after sufficient tran- 
sients with the integration step h = 0.01 and sampling rate At = 100. The generalized 
autocorrelation functions Pi(t) and P 2 (t) (Fig. Ek) for the coupling 6 3 = 0.6 show that the 
maxima of both systems do not occur simultaneously and there exists a drift between them, 
so there is no synchronization at all. This is also reflected in the rather low value of CPR 
= 0.381. For 63 e (0.78,1.381), from Fig. we observe the first substantial increase of 
recurrence reaching CPR ~ 0.5 — 0.6. Looking into the details of the generalized correlation 
functions P(t), we find that now the main oscillatory dynamics becomes locked, i.e. the 
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main maxima of Pi and P2 coincide. For 63 e (1.382,2.2) CPR reaches almost 1 as seen in 
Fig. [7J while now the positions of all maxima of P\ and P2 are also in agreement and this is 
in accordance with strongly bounded nature of phase differences. This is a strong indication 
for CPS. Note, however that the heights of the peaks are clearly different (Fig. Eb). The 
differences in the peak heights indicate that there is no strong interrelation in the ampli- 
tudes. Further increase of the coupling (here 63 = 2.21) leads to the coincidence of both the 
positions and the heights of the peaks (Fig. [6b) referring to GS in systems fl4]). This is also 
confirmed from the maximal values of the indices JPR = 1 and SPR = 1, which is due to 
the strong correlation in the amplitudes of both systems. It is clear from the construction of 
SPR that it measures the similarity between the generalized autocorrelation functions P\(t) 
and P%{€). In the regimes of CPS, as the generalized autocorrelation functions coincide in 
almost all the regimes except for the height of its maxima, it is also quantified by larger 
values of SPR. The index SPR in Fig. [7] also shows the onset of CPS and it fluctuates around 
the value 1 in the regime of CPS (63 G (1.382,2.2)) before reaching saturation confirming 
the strong correlation in the amplitudes of both the systems, thereby quantifying the exis- 
tence of GS. The transition from non-synchronized state via CPS to GS is characterized by 
the maximal values of CPR, SPR and JPR (Fig. [7J). As expected from the construction of 
these functions, CPR refers mainly to the onset of CPS, whereas JPR quantifies clearly the 
onset of GS and SPR indicates both the onset of CPS and GS. In this connection, we have 
also confirmed the onset and existence of GS by using the auxiliary system approach 52] 
introduced by Abarbanel et al for the range of the coupling strength 63 > 2.2. 



C. CPS from spectrum of Lyapunov exponents 

The transition from non-synchronization to CPS is also characterized by changes in the 
Lyapunov exponents of the coupled time-delay systems (HI). The spectrum of the eight largest 
Lyapunov exponents of the coupled systems is shown in Fig. [81 From this figure one can 

(2) 

find that all the positive Lyapunov exponents, except the largest one (AmL), corresponding 
to the response system suddenly become negative at the value of the coupling strength 
63 = 0.78 which is an indication of the onset of transition regime. One may also note 
that at this value of 63 already one of the Lyapunov exponents of the response system 
attains negative saturation while the another one reaches negative saturation slightly above 
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&3 = 0.78. This is a strong indication that in this rather complex attractor the amplitudes 
)ecome somewhat interrelated already at the transition to CPS (as in the funnel attractor 
of the Rossler system). Also the third positive Lyapunov exponent of the response 



system gradually becomes more negative from 6 3 = 0.78 and reaches its saturation value 
at 63 = 1.381 confirming the onset of CPS (which is also indicated by the transition of 
the indices of CPR and SPR in Fig. [7] in the range of 63 G (0.78, 1.381)). It is interesting 

(2) (2) 

to note that the Lyapunov exponents of the response system X\ (other than Amos) are 
changing already at the early stage of CPS (63 G (0.78, 1.381)), where the complete CPS is 
not yet attained. This has also been observed for the onset of CPS in phase- coherent and 



non- phase-coherent oscillators without time-delay [ill. |22|. |54|. 



IV. CPS IN COUPLED MACKEY-GLASS SYSTEMS 

In this section, we will bring out the existence of CPS in coupled Mackey-Glass systems 
of the form 

x x {t) = -axiit) +biXi{t-T)/(l.Q + xi{t-T) w ), (14a) 
x 2 (t) = - ax 2 (t) + b 2 x 2 (t - r)/(1.0 + x 2 (t - r) 10 ) 

+ b 3Xl (t - r)/(1.0 + xi(t - r) 10 ), (14b) 

where a, 61, b 2 are constants, 63 is the coupling parameter, and r is the delay time. 



We have chosen the parameter values (cf. [32|, |47|]) as a = 0.1, 61 = 0.2, b 2 = 0.205, 
t = 20 and varied the coupling strength 6 3 . The non-phase-coherent chaotic attractor of 
the system xi(t), Eq. (JT^k ). for the above choice of parameters is shown in Fig. [T0h and it 
possesses one positive and one zero Lyapunov exponents. Similarly, the second system x 2 (t), 
Eq. (114b ). also exhibits a non-phase-coherent chaotic attractor with one positive and one 
zero Lyapunov exponents for the chosen parametric values in the absence of the coupling 
strength 63. The parameters b\ and b 2 contribute to the parameter mismatch between the 
systems X\{t) and x 2 (t). The spectrum of the first four maximal Lyapunov exponents of both 
systems (tHh) and (114b) are shown in Figs. [9k. and [9b respectively as a function of delay 



time r G (14, 37) when 63 = 0. The Kaplan and Yorke 47], [5Q| dimension calculated using ([5]) 
for the present systems ( (fT4k ) and (114b )) work out to be 2.27969 and 2.21096, respectively. 
Now, the existence of CPS as a function of the coupling strength in the coupled Mackey- 
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Glass systems ( 114]) will be discussed using the above three approaches used for identifying 
CPS in coupled piecewise-linear time-delay systems fll|. 

A. CPS from Poincare section of the transformed attractor (Fig. 110b ) 

The non-phase-coherent chaotic attractor (Fig. ITUa) of the Mackey-Glass system is trans- 
formed into a smeared limit cycle-like attractor (Fig. [TUb) using the same transformation 
(EJ) as used for the piecewise-linear time-delay systems. For the attractor (Fig. [TUh) of the 
Mackey-Glass system, the optimal value of the delay time f in Eq. (JU]) is found to be 8.0. 
The Poincare points are shown as open circles in the Fig. [TUb from which the instantaneous 
phase 4>l(t) is calculated using (1A4|) . The existence of CPS in the coupled Mackey-Glass 
systems ( 114]) is also characterized by the phase locking condition (jTJ) as shown in Fig. [TTl 
The phase differences A0 = 4>\{t) — (friit) between the systems (114a) and (114b ) for the values 
of the coupling strength 63 = 0.04, 0.08, 0.11, 0.12 and 0.3 are shown in Fig.[TTJ For the value 
of the coupling strength 63 = 0.3, there exists a strong boundedness in the phase difference 
showing high quality CPS. The mean frequency ratio Q 2 /^i calculated from ([8]) along with 
the mean frequency difference AQ is shown in the Fig. [T2h . The value of mean frequency 
ratio f^/^i ~ 1 in the range of 63 G (0.12,0.23) corresponding to the transition regime 
(which is also to be confirmed from the indices CPR and JPR in the next subsection), see 
the inset of Fig. [T2k . Similarly the mean frequency difference is also AQ « confirming 
the transition regime. For the value of b 3 > 0.23 both quantities f^A^i an d AQ acquire the 
complete saturation in their values confirming the existence of CPS. Further, the mutual 
information calculated using Eq. (J9j clearly indicates the increase in the degree of PS for 
the value of coupling strength 63 > 0.23 as shown in Fig. [T2b . which is also in agreement 
with the frequency ratio Q 2 /^i and the mean frequency difference AQ shown in Fig. [T2"b . 

B. CPS from recurrence quantification analysis 

The existence of CPS from the original non-phase- coherent chaotic attractors of the 
systems (I14p is analyzed in this section using the recurrence quantification measures defined 
in the section II. B. We have estimated these measures again using a set of 5000 data points, 
and the same integration step and the sampling rate as used in the case of coupled piecewise- 
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linear time-delay systems (jlj). The maxima of generalized autocorrelations of both the drive 
P\{t) and the response P2(t) systems (Fig. fT3h) do not occur simultaneously for 6 3 = 0.1, 
which indicates the independent evolution of both the systems without any correlation and 
this is also reflected in the rather low value of CPR = 0.4. For 6 3 = 0.3, the maxima of 
both P\(t) and are in good agreement (Fig. [T3"b) and this shows the strongly bounded 
phase difference. It is to be noted that even though both the maxima coincide, the heights of 
the peaks are clearly of different magnitudes contributing to the fact that there is no strong 
correlation in the amplitudes of both the systems indicating CPS. Both the positions and the 
peaks are in coincidence (Fig. [13b) for the value of coupling strength 63 = 0.9 in accordance 
with the strong correlation in the amplitudes of both the systems f)14p corresponding to GS. 
This is also reflected in the maximal values of both JPR=1 and SPR=1. The spectra of 
CPR, JPR and SPR are shown in Fig. [TU The onset of CPS is shown by the first substantial 
increase of the index CPR at 63 = 0.11 and the transition regime is shown by the successive 
plateaus of CPR in the range 63 G (0.12,0.23). The maximal values of CPR for 63 > 0.23 
indeed confirm the existence of high quality CPS. The existence of GS is also confirmed 
from both the indices JPR and SPR. 



C. CPS from spectrum of Lyapunov exponents 

The onset of CPS is also characterized by the changes in the spectrum of Lyapunov 
exponents of the coupled Mackey- Glass systems (|T4"1) . The spectrum of the first four largest 
Lyapunov exponents of the coupled systems (fT4"j) is shown in Fig. [151 The zero Lyapunov 
exponent of the response system £2^) already becomes negative as soon as the coupling is 
introduced and the onset of CPS is indicated by the negative saturation of the zero Lyapunov 
exponent at 63 = 0.11. The positive Lyapunov exponent of the response system becomes 
gradually negative in the transition regime (63 G (0.12,0.23)) and it reaches its negative 
saturation at 63 = 0.23 at which high quality CPS exists. The transition of the positive 
Lyapunov exponent to negativity in this rather complex attractor is again a firm indication 
of some degree of correlation in the amplitudes of both systems even before the onset of 
CPS. As noted earlier, this behaviour of negative transition of positive Lyapunov exponent 



of response system before CPS has also been observed in Refs. 



11 



22 



54). 
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V. SUMMARY AND CONCLUSION 



We have identified and characterized the existence of CPS in both the coupled piecewise- 
linear time-delay systems and in the coupled Mackey-Glass systems possessing highly non- 
phase-coherent chaotic attractors. We have shown that there is a typical transition from 
a non- synchronized state to CPS and subsequently to GS as a function of the coupling 
strength in both systems. Similar results are obtained for different sampling intervals At 
and for various values of delay time r. 

We have introduced a suitable transformation, which works equally well for both the 
systems possessing characteristically distinct attractors (hyperchaotic attractor in piecewise 
linear time-delay system and chaotic attractor in the Mackey-Glass system), to capture the 
phase of the underling non-phase-coherent attractor. Both the phase and the frequency 
locking criteria are satisfied by the instantaneous phases calculated from the transformed 
attractors in both the piecewise-linear and the Mackey-Glass time-delay systems. The fre- 
quency ratio and its difference as a function of coupling strength clearly shows the onset 
of CPS in both cases. We have also characterized the existence of CPS and GS in terms 
of recurrence based indices, namely generalized autocorrelation function P(t), CPR, JPR 
and SPR and quantified the different synchronization regimes in terms of them. The onset 
of CPS and GS are also clearly shown by the spectra of CPR, JPR and SPR. The above 
transition is also confirmed by the changes in the spectrum of Lyapunov exponents. The 
recurrence based technique as well as the new transformation are also appropriate for the 
analysis of experimental data and we are now investigating the experimental verification of 
these findings in nonlinear electronic circuits and in biological systems. Also the recurrence 
based indices are found to be more appropriate for identifying the existence and analysis of 
synchronizations, in particular CPS, and their onset in the case of nonlinear time-delay sys- 
tems in general, where very often the attractor is non-phase-coherent and high-dimensional. 
It is also to be emphasized that the recurrence based measures are more efficient than other 
nonlinear techniques [391] such as mutual information, predictability, etc. These measures 
have high potential for applications and we are also investigating the possibility of extending 
these techniques to complex networks. 
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APPENDIX A: CPS IN CHAOTIC SYSTEMS: PHASE-COHERENT AND NON- 
PHASE-COHERENT ATTRACTORS 

Definition of CPS in coupled chaotic systems is derived from the classical definition of 
phase synchronization in periodic oscillators. Interacting chaotic systems are said to be 
in phase synchronized state when there exists entrainment between phases of the systems, 



while their amplitudes may remain chaotic and uncorrelatec 



In other words, CPS exists 



when their respective frequencies and phases are locked . To study CPS, one has 

to identify a well defined phase variable in both coupled systems. If the flow of the chaotic 
oscillators has a proper rotation around a certain reference point, the phase can be defined 
in a straightforward way. In this case the corresponding attractor is referred to as a phase- 



coherent attractor in the literature 



straightforwardly as 



0, y,& 



13, 



33, 



381 ] and the phase can be introduced 



<p(t) = arctan(y(t)/a;(t)). 



(Al) 



A more general approach to define the phase in chaotic oscillators is the analytic signal 
approach 1, 4] introduced in j^]. The analytic signal x(t) is given by 



x (t) = s{t) + is(t) = A(t) exp^W, 

where s(t) denotes the Hilbert transform of the observed scalar time series s(t) 

s(t>) 



I l"X> 

-P.V. 



7T 



t-t 



7< 



(A2) 



(A3) 



where P.V. stands for the Cauchy principle value of the integral and this method is especially 
useful for experimental applications [l|, |4j. 

The phase of a chaotic attractor can also be defined based on an appropriate Poincare 
section which the chaotic trajectory crosses once for each rotation. Each crossing of the 
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orbit with the Poincare section corresponds to an increment of 2tt of the phase, and the 



phase in between two crosses is linearly interpolated 



$(t) = 2nk + 2tt — — , (t fc < t < t fc+ i) (A4) 

tk+l — tk 

where tk is the time of kth crossing of the flow with the Poincare section. For the phase 
coherent chaotic oscillators, that is, for flows which have a proper rotation around a certain 
reference point, the phases calculated by these three different ways are in good agreement [l|, 
4|- 

As a typical example, consider the Rossler system 

x — — y — z, (A5a) 
y = x + ay, (A5b) 
z =0.2 + z(x -8.5). (A5c) 

The topology of the attractor of the Rossler system is determined by the parameter a. For 
a = 0.15, a phase-coherent attractor (see Fig.[T6a) is observed with rather simple topological 



properties 56|, |57j], (where the projection of the chaotic attractor on the (x, y) plane looks 
like a smeared limit cycle with the phase point always rotates around a fixed origin with 
monotonically increasing phase) and hence the phase can be calculated straightforwardly as 
discussed above. 

However, in chaotic dynamics one often encounters non-phase-coherent attractors where 
the flows are without a proper rotation around a fixed reference point (with the origin 
coinciding with the center of rotation), in which case a single characteristic time scale does 
not exist in general. In such circumstances it is difficult or impossible to find a proper center 
of rotation and it is also intricate to find a Poincare section that is crossed transversally by 
all trajectories of the chaotic attractor. As a consequence such a non-phase-coherent chaotic 
attractor is not characterized by a monotonically increasing phase. Hence phase of such a 
non-phase-coherent attractor cannot be defined straightforwardly as in the case of phase- 
coherent attractor. Therefore the above definitions of phase are no longer applicable for 
non-phase-coherent chaotic attractors. So specialized techniques/tools have to be identified 
to introduce phase in non-phase-coherent attractors. 

It has also been demonstrated that certain non-phase- coherent chaotic attractors can be 
transformed into smeared limit-cycle like attractors by introducing a suitable transformation 
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of the original variables. For example, in the case of Lorenz attractor, a transformation of 
the form 

u(t) = ^x 2 + y 2 (A6) 

is introduced [l| and the projected trajectory in the plane (u, z) resembles that of the Rossler 
attractor. Now phase of the respective attractor is introduced using the above approaches 
for phase-coherent attractors. 

However, such a transformation does not always exist or can be found in the case of 
non-phase-coherent attractors in general. Ag typical example consider the Rossler 

system specified by Eq. (IA5j) . The topology of the Rossler attractor changes dramatically 
if the parameter a exceeds 0.21 and the phase in this case is not well defined. Funnel (non- 
phase-coherent) attractor for the value a = 0.25 is shown in Fig. [16b. There are large and 
small loops (see Fig. [16b) on the (x, y) plane and it is not evident which phase gain should 
be attributed to these loops and hence phase cannot be calculated simply as in the case of 
phase-coherent chaotic attractor (Fig. [T6"a) or through simple transformations. Therefore, 
recently another definition of the phase based on the general idea of the curvature has been 



proposed by Osipov et al 38]. For any two-dimensional curve r = (u,v) the angle velocity 
at each point is 

v = (ds/dt)/R, 

where ds/dt = y/ii 2 + v 2 is the speed along the curve and R = (u 2 + v 2 ) 3 ^ 2 /(vu — vu) is the 
radius of the curvature. If R > at each point, then 



vu — vu 



dt u 2 + v 2 

is always positive and hence the variable 

$ = / vdt = arctan - (A7) 
J u 

is a monotonically increasing function of time and can be considered as the phase of the 
oscillator. These definitions of frequency and phase are general for any dynamical system if 
the projection of the phase trajectory on some plane is a curve with a positive curvature. Now 
for the non-phase-coherent Rossler attractor in the funnel regime, the projections of chaotic 
trajectories on the plane (x, y) always rotate around the origin, and the phase can be defined 
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as $ = arctan(y/i) [38J. However, it is not clear whether an appropriate plane can always 
be found, on which the projected trajectories rotate around the origin for higher dimensional 
chaotic systems as such systems will very often exhibit more complicated attractors with 
more than one positive Lyapunov exponent as in the case of typical time-delay systems 
discussed in the main part of this paper. 
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FIG. 5: (Color online) (a) Mean frequency ratio f^/^i an d their difference Af2 = O2 — £l\ as 
a function of the coupling strength 63 S (0, 3) and (b) Mutual information M as a function of 
coupling strength 63. 
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FIG. 8: Spectrum of first eight largest Lyapunov exponents of the coupled systems (|3J) as a function 
of coupling strength b% € (0, 3). 
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FIG. 9: The first four maximal Lyapunov exponents X max of (a) the Mackey-Glass time-delay 
system (|14a ) for the parameter values a = 0.1, 6i = 0.2, r 6 (14,37) and (b) time-delay system 
(|14b ) for the parameter values a = 0.1, b\ = 0.205 in the same range of delay time in the absence 
of the coupling 63. 
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FIG. 10: (a) The non-phase coherent chaotic attractor of the uncoupled drive (|14a ) and (b) 
Transformed attractor in the x\{t+r) and z(t+r) space along with the Poincare points represented 
as open circles. 




5000 10000 15000 20000 25000 

t 



FIG. 11: Phase differences (Acj) = <j)f (t) — ^{t)) between the systems (|14a ) and (114b ) for different 
values of the coupling strength 63 = 0.04,0.08,0.11,0.12 and 0.3. 
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FIG. 12: (Color online) (a) Mean frequency ratio f^/^i and their difference AQ = — ^1 as 
a function of the coupling strength 63 S (0, 1) and (b) Mutual information M as a function of 
coupling strength 63. 
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FIG. 15: Spectrum of first four largest Lyapunov exponents of the coupled systems (|14p as a 
function of coupling strength 63 G (0, 1). 
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